Maximum entropy models from phase harmonic covariances

نویسندگان

چکیده

The covariance of a stationary process X is diagonalized by Fourier transform. It does not take into account the complex phase and defines Gaussian maximum entropy models. We introduce general family harmonic moments, which rely on phases to capture non-Gaussian properties. They are defined as Hˆ(LX), where L linear operator Hˆ non-linear multiplies each coefficient integers. can also be calculated from rectifiers, relates Hˆ(LX) neural network coefficients. If transform then sparse matrix whose non-zero off-diagonal coefficients dependencies between frequencies. These have similarities with high order but smaller statistical variabilities because Lipschitz. wavelet reveal across scales, specify geometry local coherent structures. models conditioned these covariances. precision numerically evaluated synthesize images turbulent flows other processes.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Chunking with Maximum Entropy Models

Maximum Entropy (MaxEnt) models (Jaynes, 1957) are exponential models that implement the intuition that if there is no evidence to favour one alternative solution above another, both alternatives should be equally likely. In order to accomplish this, as much information as possible about the process you want to model must be collected. This information consists of frequencies of events relevant...

متن کامل

Compact Maximum Entropy Language Models

In language modeling we are always confronted with a sparse data problem. The Maximum Entropy formalism allows to fully integrate complementary statistical properties of limited corpora. The focus of the present paper is twofold. The new smoothing technique of LM-induced marginals is introduced and discussed. We then highlight the advantages resulting from a combination of robust features and s...

متن کامل

From Maximum Entropy to Maximum Entropy Production: A New Approach

Evidence from climate science suggests that a principle of maximum thermodynamic entropy production can be used to make predictions about some physical systems. I discuss the general form of this principle and an inherent problem with it, currently unsolved by theoretical approaches: how to determine which system it should be applied to. I suggest a new way to derive the principle from statisti...

متن کامل

Mixtures of Conditional Maximum Entropy Models

Driven by successes in several application areas, maximum entropy modeling has recently gained considerable popularity. We generalize the standard maximum entropy formulation of classification problems to better handle the case where complex data distributions arise from a mixture of simpler underlying (latent) distributions. We develop a theoretical framework for characterizing data as a mixtu...

متن کامل

How biased are maximum entropy models?

Maximum entropy models have become popular statistical models in neuroscience and other areas in biology, and can be useful tools for obtaining estimates of mutual information in biological systems. However, maximum entropy models fit to small data sets can be subject to sampling bias; i.e. the true entropy of the data can be severely underestimated. Here we study the sampling properties of est...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied and Computational Harmonic Analysis

سال: 2021

ISSN: ['1096-603X', '1063-5203']

DOI: https://doi.org/10.1016/j.acha.2021.01.003